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Dynamics with a threshold input-output relation commonly exist in gene, signal-transduction, 
and neural networks. Coupled dynamical systems of such threshold elements are investigated, in 
an effort to find differentiation of elements induced by the interaction. Through global diffusive 
coupling, novel states are found to be generated that are not the original attractor of single-element 
threshold dynamics, but are sustained through the interaction with the elements located at the 
original attractor. This stabilization of the novel state(s) is not related to symmetry breaking, but 
is explained as the truncation of transient trajectories to the original attractor due to the coupling. 
Single-element dynamics with winding transient trajectories located at a low-dimensional manifold 
and having turning points are shown to be essential to the generation of such novel state(s) in a 
coupled system. Universality of this mechanism for the novel state generation and its relevance to 
biological cell differentiation are briefly discussed. 
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PACS numbers: 87.10.+e, 05.45.Ra, 87.18-h 



I. INTRODUCTION 

Differentiation of identical units through interaction is 
an important issue both in physics and biology. Through 
developmental process, cells with identical genes start 
to take different chemical compositions; this process is 
known as cell differentiation [J, Several distinct types 
of cells are generated that take different compositions of 
gene expressions. Theoretically, on the other hand, state 
differentiation of identical units has been studied in dy- 
namical systems, by using a coupled dynamical system, 
such as coupled chaotic systems 3[ or coupled oscillators 
1- 

In coupled dynamical systems with identical elements, 
there is a homogeneous state in which all elements take 
an identical value. If this homogeneous state is un- 
stable, differentiation of elements follows. This has 
been studied extensively as symmetry breaking. For 
example, by losing the synchronization in oscillations, 
elements arc differentiated into clusters with different 
phases of oscillation, in coupled chaotic or coupled oscil- 
lator systems [1, Q . Here the differentiation occurs with 
regards to the phase of oscillation. 

In a biological cell, differentiation is more drastic. Dif- 
ferent composition of chemicals or, in other words, dif- 
ferent types of gene expression appear, and the differ- 
entiation is not with regard to the phase of oscillation 
but in fixed composition of chemicals (e.g. proteins). To 
describe cell differentiation as a coupled system of intra- 
cellular oscillatory dynamics, isologous diversification has 
been proposed while its dynamical systems analysis 
is not as yet fully developed. 

In gene expression dynamics of a cell, the basic pro- 
cess is on/off output against input (s), with some thresh- 



old function, rather than oscillatory dynamics^- In the 
present paper, we report a novel mechanism for state 
differentiation, by taking elements with such threshold 
function (i.e., y = tanh{j3x) with (5 > l)and coupling 
them globally with each other through simple diffusion 
coupling. By varying several parameters, we find the 
generation of novel states in a coupled system that are 
not attractors of the original single-element dynamics. 
This differentiation of states is not explained as sym- 
metry breaking and, indeed, the original attractor also 
remains stable. To explain such coupling-induced gener- 
ation of novel stable states, we propose a transient trun- 
cation mechanism, which brings about stabilization of 
stagnation point(s) in transient trajectories, mediated by 
interaction with elements that have already fallen on the 
original attractor. We show how this mechanism works, 
and describe the condition for the generation and stabi- 
lization of novel states. Generality of this mechanism in 
a coupled threshold dynamics model is discussed, as well 
as its extension and relevance to cell differentiation. 



II. MODEL 

Gene expression and signal transduction [f| as well as 
neural response^ often follow threshold dynamics, where 
the output y can be represented by y = tanh((3x) as x 
as an input and [3(> 1) as a parameter representing the 
sensitivity. The input to each variable (gene or neuron) 
comes from several genes (or neurons) that are connected 
through excitatory or inhibitory couplings. For such dy- 
namics, the following threshold dynamics model is often 
adopted; 
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where iEj is the state of zth variable (e.g., gene expres- 
sion) with i = 0,1,..., M — 1, while the component of 
connection matrix Jij takes a value from positive to neg- 
ative values Here, we study the case in which Jy 
takes either —1 or 1 that is selected randomly, as is used 
in the spin-glass modelfllj], while the specific form of the 
distribution of Jij is not important for discussion of the 
result. The threshold value 9i is fixed, and is also dis- 
tributed over [-1,1]. The parameter (3, representing the 
sensitivity, is fixed at 4 in the present paper, while the 
behavior to be discussed is unchanged as long as /3 > 1. 

Now, we consider an ensemble of elements, each of 
which follows the same equation (1) as single-element dy- 
namics, and introduce interaction among such elements. 
For example, consider N cells, each of which has identi- 
cal gene expression dynamics. Then, the global behavior 
of an ensemble of these cells is represented by the above 
intra-cellular dynamics and interaction among them. In- 
stead of Xi , we need to study the dynamics of the variable 
Xi(k), the state of the ith component (e.g., zth gene) 
of the k-th element (cell). Here we take the simplest 
form of interaction, diffusive, global coupling, to all ele- 
ments (cells). Now, the model we discuss is written as 
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ii(k) = tanh[/3 JijXj(k) — 6j\ — xi(k) 

+Di(xi - Xi(k)) (2) 

with k = 1,2,. ..,7V, and x t = (1/JV) J2i=i x iW is thc 
average value of the ith component over all elements, 
while Di is the strength of this diffusive coupling over 
elements. We use the present mean-field model (global 
coupling) as an idealized basic system. 

Of course, another choice in the coupling form is spa- 
tially local interaction, such as the nearest-neighbor diffu- 
sion coupling among elements located on a lattice. Here, 
we use the above global interaction, because we are inter- 
ested in the basic property of coupled threshold dynamics 
and state differentiation. In general, with the choice of 
spatially local interaction, differentiation of state values 
by elements appears more easily, while the mechanism to 
be described for the global interaction works even for the 
local interaction case. 

In a biological context, this type of model was dis- 
cussed, for instance by Mjolsness et al.[l2j and Salazar- 
Ciudad et al.[l3j], in relationship with the problem of 
cell differentiation, where these authors chose the in- 
teraction Jij and (local) cell-cell interaction to meet a 
specific biological situation. Here, we are interested in 
general features of this class of models, so that we have 
chosen the simplest situation, as described above. In a 



physics context, the above model (with local coupling) 
was studied analytically and numerically by Hansel and 
Sompolinskv 14j. as a model for spatiotemporal chaos, 
where their interest is focused on the limit with M — > oo, 
and fully chaotic behavior. Our interest in the present 
paper lies in the differentiation into distinct stable states 
(mostly fixed points) for a system with a relatively small 
M. 



III. GENERATION OF NOVEL STATES BY 
TRANSIENT TRUNCATION MECHANISM 

The single-element dynamics (1) (or the model (2) with 
Di = for all i) can have multiple attractors in general, 
which are either a fixed-point, limit cycle or strange at- 
tractor. To discuss the interaction-induced generation of 
novel states other than the attractor(s) of a single ele- 
ment dynamics (1), however, it would be better to study 
the case with only one attractor at first. 

In fact, the behavior of a coupled dynamical system 
has been studied extensively, when an element system 
has only one limit-cycle or chaotic attractor. If the at- 
tractor is a limit cycle, synchronization among elements 
often occurs through the coupling, while, if the attractor 
is chaotic, clustering of elements into several states can 
occur0, |j| . In the latter case, state values are differen- 
tiated by elements, as a result of the instability of the 
homogeneous (synchronized) state, while the differentia- 
tion is understood as symmetry breaking. Indeed, in our 
model (2), such clustering is generally observed when the 
single-element dynamics (1) shows chaotic or oscillatory 
dynamics. 

On the other hand, if the attractor of single-element 
dynamics (1) is a fixed point, a homogeneous state of 
the fixed point over all elements is always stable in the 
present diffusive coupling system. Then, the generation 
of novel states other than the fixed point is not possi- 
ble by the symmetry-breaking mechanism. However, we 
have found several examples in which the coupled system 
(2) exhibits differentiation of state values, when started 
from initial conditions far from a homogeneous state. In- 
homogeneous states with Xi{k) ^ Xi(j) are observed, for 
some network Jij, and for some values of {Di}, and 9(i). 

An example of such behavior is shown in FigfT] and 
Figl^l where M = 5. The corresponding single element 
dynamics (1) has only a fixed-point attractor. Here we 
choose 
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where + denotes 1 and — denotes -1, 9 =(0.14, -0.75, 
0.71, -0.78, 0.32), and D = (0.95, 0.027, 0.30, 0.18, 0.95). 
while several other choices of J, Di, and 9(i) give rise to 
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FIG. 1: (Color Online) Time series of xi of the threshed 
dynamics model with M — 5. (a) Overlaid time series of 
single-element dynamics (1), from 10 initial conditions chosen 
randomly. From all initial conditions, a single, fixed-point at- 
tractor is reached, (b) Time series of the coupled dynamics 
model (2) overlaid for 30 elements chosen from N = 100 ele- 
ments, for a single initial condition. Other than the original 
fixed point of (a), another fixed-point state is reached, which 
is stabilized by the interaction. The matrix J and parameter 
values are chosen as follows. 



the similar behavior. The time series of X2 of a single- 
element dynamics (1) are plotted in FigJTJa) by taking a 
variety of initial conditions, which shows the relaxation to 
a single, fixed-point attractor. In Figfljb), the time series 
of X2(k) over several elements are plotted. One can see 
differentiation of final state values into two fixed-point 
values, one of which corresponds to the original fixed- 
point value of the single element dynamics (1), although 
the value of the fixed point is slightly shifted, due to the 
coupling term. The other fixed-point value, on the other 
hand, does not have a correspondent in the single-element 
dynamics. 

Corresponding to these time series, we have plot- 
ted a two-dimensional projection of orbits from the 5- 
dimensional phase space. Figf^a) again shows the single- 
element dynamics (1) without interaction. Each line rep- 
resents time evolution of (xo,x^) starting from different 
initial conditions, while Figf^b) shows the evolution of 
the coupled system (2), where an orbit from a single ini- 
tial condition is plotted, with each line as an orbit of each 
element. One can again see clearly that a novel attracting 
state ('N') other than the original fixed point attractor 
Xi(k) = x* ('O')is created through the interaction. 
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FIG. 2: (Color Online) The trajectory of the model corre- 
sponding to Fig.l. (xo(k),Xi(k)) is plotted as a projection to 
two-dimensional plane from the 5-dimensional phase space, 
(a) Single-element dynamics corresponding to Fig. 1(a). Over- 
laid plot over 25 initial conditions. All the orbits are attracted 
to the fixed point denoted by "O". (b) Coupled dynamics 
model corresponding to Fig. 1(b). Overlaid plot for 30 ele- 
ments chosen from N=100. The orbits are either attracted to 
the original attractor shown as "O" (a green circle), or to a 
novel fixed point state denoted by 'N' (represented by a vio- 
let circle). The latter is stabilized by the interaction . About 
one third of elements are attracted to 'N', while others are 
attracted to the original attractor 'O'. Note that the location 
of the state corresponding to the original attractor is slightly 
shifted by the coupling term with the elements at the novel 
state. 



Recall that the homogeneous state with Xi(k) = x* 
for all elements k is always stable. Indeed, when ini- 
tial condition is set so that the states of all elements are 
located near this fixed point, the attractor Xi{k) = x* 
is always reached. In this sense, the present mechanism 
differs distinctly from the clustering or other mechanisms 
based on spontaneous symmetry breaking. Besides the 
stable homogeneous state, there appears a macroscopic 
state consisting both of the elements at the original fixed 
point and a novel fixed point, when the initial condition 
of elements is set far from homogeneity. (In most exam- 
ples, we choose a random initial condition where Xi(k) is 
taken randomly from [-1,1].) Here the novel fixed point 
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'N' is stabilized by the coupling with other elements lo- 
cated at 'O'. 

Indeed, by taking a variety of networks Jy , we have 
observed several examples of formation of such novel 
state(s), and found a common mechanism. The mech- 
anism of the generation of novel state(s) other than the 
original fixed-point attractor is explained as follows: 

Consider the case in which a single unit dynamics has 
long-winding transient trajectories before they reach the 
original unique fixed point ('O'), as shown in FigfSJa). 
During the transient process, the orbit has (a few) turn- 
ing points at which the motion of x% (t) is slowed. While 
some elements have reached the original fixed point fast, 
others are still on a route to it. At some of turning points, 
the relaxation of an element take a course once going 
farther away from the original fixed point 'O'. On the 
other hand, the diffusive coupling with elements that has 
already reached the original final fixed point drives the 
transient element toward it ( see FigJ3]for schematic rep- 
resentation). This coupling suppresses the relaxation of 
single-element dynamics toward the original fixed point. 
When the directions of the original relaxation and the at- 
traction to the original fixed point are opposite, the two 
driving forces may balance each other around a turn- 
ing point where the motion is stagnated (see 'stagnation' 
point 'S' in Fig[3]). Then, the relaxation to the origi- 
nal fixed point is truncated, and some elements remain 
around this stagnation point, to create an interaction- 
induced novel state, as shown in Fig[2] and FigO 




FIG. 3: (Color Online) Schematic representation of transient- 
truncation mechanism. Original relaxation of single element 
dynamics takes a course A — > B — > S — > O, while the inter- 
action with elements near O hinders the relaxation from A to 
S. 



This 'transient-truncation' mechanism works under the 
following condition; 



(1) The loci of transient orbits are restricted within 
a low-dimensional manifold: If the transient trajectories 
cover a high-dimensional region in the phase space, orbits 
from different elements approach the original attractor 
from a variety of directions, and the transient truncation 
by the diffusion coupling does not work effectively. When 
the transient-truncation mechanism works, many points 
reach the original attractor, taking a specific course re- 
stricted within low-dimensional region in the phase space, 
as displayed in FigJ5] Contraction to the low-dimensional 
manifold is so strong that each element is located within 
a low-dimensional manifold, as shown schematically in 
Figj3] (as thick red arrows toward A), 

(2) The transient orbit has one or several turning 
points. At some turning point, the single-element mo- 
tion is stagnated where the orbit stays for a long time, 
so that the driving force by the single-element dynamics 
is weak there. Hence, the diffusive coupling to the origi- 
nal fixed point is sufficient to stop the original relaxation 
course. See FigJ3]for example. 

(3) The direction of transient orbit around this stag- 
nation point is roughly "opposite" to the direction to the 
original fixed point, attracted by the diffusive coupling. 
Then, the orbit is trapped around this stagnation point, 
as shown in FigJ^l 

Since the interruption of transient dynamics is caused 
by the diffusive coupling to the elements already fallen 
on the original fixed point, the degree of interruption de- 
pends on the number of such elements, which is denoted 
by N f , 

To study how the stability of the novel state changes 
with Nf , we have computed the largest eigenvalue of the 
Jacobi matrix of the evolution equation at this novel fixed 
point ('N') induced by coupling. If the eigenvalue is nega- 
tive, this novel fixed-point state is stable. This eigenvalue 
depends on the number Nf, (or more generally, on the 
ratio Nf/N). We have plotted this eigenvalue against 
the ratio I — Nf/N, i.e., the fraction of the elements 
at the novel state. As shown in FigJH the eigenvalue is 
negative only if Nf is larger than some threshold, while 
it decreases with the increase of Nf. In other words, 
the novel state is sustained only under the existence of 
a moderate number of the elements at the original fixed 
point. Existence of the threshold number for Nf is natu- 
ral, since the new state is sustained by "attractive force" 
to the original fixed point. 

According to the above mechanism, the appropriate 
strength of diffusion coupling is necessary to stabilize 
the novel state. Indeed, the present transient trunca- 
tion mechanism works only for a given range of diffusion 
constants. If it is too small, the attraction to the original 
fixed point is too weak to interrupt the relaxation course 
of the single-element dynamics, so that all the elements 
fall on the original fixed point. On the other hand, when 
the diffusion coupling is too large, the diffusion coupling 
dominates so that all the elements take the same value. 
Then, the dynamics follow the single-element dynamics 
(I), so that all elements fall on the original fixed point. 
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FIG. 4: (Color Online) Dependence of the stability of the 
novel state upon Nf, the number of elements located at the 
original fixed-point attractor. By using the same model for 
Fig.(l)-(2), we have computed the largest eigenvalue of the 
Jacobi matrix of the novel fixed-point state, by fixing the 
number of elements at the original attractor at Nf. Here 
the eigenvalue is plotted as a function of (TV — Nf)/N, i.e., 
the fraction of the number of elements at the novel state. 
When the eigenvalue exceeds zero, the state is no longer sta- 
bilized, and the exponent is not computed. Different sym- 
bols corresponds to different sets of diffusion coupling Di, 
which is changed by fixing Di/D = 0.448, D 2 /D = 0.19, 
D 3 /D = 0.078,D 4 /D = 0.052, and changing only D , as 
shown in the figure. 



(See Fig[5]for the diffusion constant dependence of the ex- 
istence of the novel state, where Di is changed by keeping 
the proportion among D\s (i.e., fixing Di/Dj)). 



. :: 








■ ■ 
■ 
■ ■ 

■ 
■ 

■ 
■ 
■ 
■ 

■ 





10e-4 10e-3 10e-2 10e-1 10e+0 10e+1 10e+2 10e+3 
Do 

FIG. 5: (Color Online) Fraction of elements fallen on the 
novel state is plotted against the strength of diffusion cou- 
pling. The fraction is measured over 50 randomly chosen 
initial conditions. Diffusion strength Di is changed by fix- 
ing Di/Do and varying Do, in the same way as in Fig.4, and 
changing only Do as shown. The fraction is plotted against 
Do. For Do < O.f and Do > 100, the novel fixed-point state 
does not exist, and all the elements fall on the original fixed 
point. 



IV. GENERALIZATION 

We have studied the behavior of the model (2) by tak- 
ing a variety of networks and by changing N and M, to 
find that the generation of novel states by the mecha- 
nism of the last section is general. We have computed 
the fraction of the networks that show the generation of 
novel state(s) from fixed-point attractor (s), by the above 
mechanism. The fraction of the network (and 6j) for such 
behavior remains to be 1 ~ 5 %, when M is changed from 
8 to 64. Here, we have computed 100 networks for each 
of M, and the transient-truncation mechanism from fixed 
point attractor (s) is observed for 1 ~ 5 networks among 
them. We also note that the present mechanism also 
works, even if the coupling is sparse, in the sense 
that many of J^ 's are set at 0. For example, we have 
observed the novel state generation by transient trunca- 
tion, with a similar fraction, for a system with = 
for 70 % of the matrix. 

Another type of non-trivial behavior of the coupled 
system (2) is clustering of elements into different phases 
of oscillations, when the single element shows (chaotic) 
oscillation, as was discussed in globally coupled mapsQ. 
The fraction of networks showing the clustering also in- 
creases with M, as shown in Fig|6] This is natural, since 
chaotic behavior is more frequently observed in a single- 
element dynamics fl4j|. In other words, the network only 
with fixed-point attractors for single-element dynamics 
decreases with M. Hence, among the networks hav- 
ing only fixed-point attractors, the fraction to show the 
transient-truncation mechanism slightly increases with 
M[Tj|. 
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FIG. 6: (Color Online) Fraction of networks that exhibit oscil- 
latory dynamics for single-element dynamics. For each value 
of M, we have chosen 100 networks with randomly chosen Jij, 
and carried out the simulation without coupling, to check if 
there is a limit-cycle or a chaotic attractor. For the corre- 
sponding coupled system, clustering of elements into a few 
groups is observed with the increase of the coupling strength, 
and then a synchronized state over elements appears for the 
further increase of coupling, as is studied in globally coupled 
maps@|. N is fixed at 128. 



Although the generation of coupling-induced novel 
state (s) is common to the networks above, it is often more 
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complicated than the simple example in the last section 
where the original single-element dynamical system has 
only a single, fixed-point attractor. 

Even if the single-element dynamics has multiple at- 
tractors, the transient-truncation mechanism still works. 
Indeed, when M is large, we observed the case in which 
novel states are generated by the coupling besides the 
original multiple attractors. For example, when there 
are two fixed point attractors in the original dynamics, 
other fixed-point (s) or a limit cycle state is stabilized due 
to the coupling, as a result of transient truncation. An 
example is shown in FigO where we choose 

/ + + + + + \ 

H 1 h + + H h 

+ H h + H 1 h 

+ + + + H 

T _ - 1 H h + + 

J ~ - + - + -- + + + - 

h + H 1 

H 1 h 

+ H h H 1 h 

\- + + -- + - + - -J 

(4) 

with 6 =( -0.27, 0.98, 0.22, -0.25, -0.92, 0.63, 0.44, 0.64 
0.74, -0.73). 

In this example, there are two fixed points, denoted by 
01 and 02, in the original single-element dynamics (1). 
There are transient trajectories that have a few turn- 
ing points, and that are attracted to 02, as shown in 
FigJTfa). With the coupling to elements located at 01 
and 02, the transient trajectory is truncated, and a limit 
cycle is generated for the remaining elements, as shown in 
FigjT^b) . This truncation is possible only if the numbers 
of elements at 01 and 02 are within some range, but the 
range is rather broad, so that the coupling-induced limit 
cycle state is observed just by starting from random ini- 
tial conditions. Furthermore, we have observed this type 
of novel limit-cycle state in a variety of networks. 

Formation of multiple novel states is also possible in 
some networks (and with suitable choice of diffusion). 
In Fig. EJc), we show an example of formation of 
two fixed-point states, by using the same network as 
in FigOJa)(b), but by taking a different set of diffusion 
couplings (Do, D i, Dm— l) given in the figure caption. 
Here, two fixed-point states, A and B, are generated 
around two stagnation points. By starting from some 
initial conditions, both of these two stagnation points be- 
come stable due to the interaction with other elements. 

Here, the novel fixed-point state A exists under the 
presence of B; otherwise the elements locating at around 
A cannot stay there, but move toward B. Hence there is 
ordering between A and B. The latter states are neces- 
sary for the former, but not vice versa. Generally, when 
there are several stagnation points S1,S2,.., along a low- 
dimensional transient orbit, and coupling- induced novel 
states are formed accordingly as N1,N2,..., there is order- 
ing with regards to their existence, as Nl exits under the 




FIG. 7: (Color Online) The trajectories (x (k)(t),x 4 (k)(t)) 
are plotted, as a projection to a two-dimensional plane from 
the M-dimensional phase space (M = 10). (a) Single-element 
dynamics (1), overlaid plot over 20 initial conditions, (b) 
Coupled dynamics model (2) corresponding to (a), with the 
coupling values D = (0.20, 0.27, 0.66, 0.41, 0.26, 0.15, 0.32, 
0.29, 0.096, 0.33). Final states are plotted for all of 100 el- 
ements. The original fixed-point attractors are shown as 01 
and 02. At (a), there are winding transient orbits that fall 
on the attractor Ol or 02. In (b), a novel limit cycle is gener- 
ated, (c) The trajectories of a coupled dynamical system with 
the same set of JV, and 6(i), but by a different set of D iy i.e., 
D = (0, 0.30, 0.0037, 0, 0.79, 0, 0, 0.0070, 0.80, 0.0028). With 
the coupling, novel fixed-point states A and B are generated, 
besides the original fixed points, instead of the limit cycle in 
(b). Trajectories of 12 elements among 100 are plotted. The 
matrix J and parameter values are chosen as follows. 
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presence of N2,N3,..., and N2 exists under N3,N4,„, and 
so forth. 

In some other networks, novel states A and B mutually 
stabilize each other; the state A exists under the pres- 
ence of elements at B, and vice versa. By removing all 
elements taking the state A, elements taking the state B 
become unstable and are absorbed into the original fixed 
point, and removing the elements taking B also results 
in the destabilization of the state A. 

Finally, the original attractor of the single-element dy- 
namics need not necessarily be a fixed point. The mech- 
anism of the transient truncation can work even if the 
original attractor is not a fixed point, but a limit cycle, 
as long as there are stagnation points along the transient 
orbits satisfying (l)-(3) in the last section. 



V. SUMMARY AND DISCUSSION 

In the present paper we have studied a coupled thresh- 
old dynamics model, to find emergence of novel states 
stabilized by the coupling. Although we have adopted 
just a simple global diffusive coupling which tends to ho- 
mogenize all the element values, there appears differen- 
tiation of the state values, induced by the coupling. The 
mechanism of the generation of novel states is explained 
as the truncation of transient orbits that are located on a 
low-dimensional manifold in the phase space. The inter- 
action with the elements that have fallen on the original 
attractor suppresses the relaxation process of the remain- 
ing elements at some stagnation point, to make it a novel 
fixed point (or a limit cycle). 

The transient-truncation mechanism is based just 
on the existence of 'winding' transient orbits on a 
low-dimensional manifold, with several turning points. 
Hence, the coupling-induced formation of novel stable 
states by this mechanism is not restricted to the present 
model. It should be generally possible in coupled dynam- 
ical systems, with the above class of transient orbits at a 
single-element level. 

Still, we have not found such differentiation in the pre- 
vious studies on coupled dynamical systems in which 
a much simpler element is adopted(such as the logistic 
map@). At least, one can conclude that the present tran- 
sient truncation appears more frequently in the coupled 
threshold dynamics model given by eq.(2). We expect 
that this is because of typical nature of transient orbits 
in (1). Indeed, in threshold dynamics, each variable tends 
to approach either 1 or -1. At some points with n a 1 
or -1 for some i's, the change in the variable values is 
slowed, and then the trajectory departs from them. The 
transient dynamics of a single element often involve such 
switchings between +1 and -1 with stagnation of motion. 
Thus the requirement on transients discussed in §3 is eas- 
ier to be satisfied in the present model than in coupled 
oscillators or coupled chaos. 

Another clear example of such stagnation is a hetero- 
clinic cycle [13, E, [13 • Although the heteroclinic cycle it- 
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FIG. 8: (Color Online): Snapshot pattern of xo for the model 
(3), with one-dimensional nearest-neighbor interaction. M = 
10 and N = 64 with a periodic boundary condition. When 
di is less than some value (~ 0.07), there exists only a single 
attractor with a spatially homogeneous state with xo f» 1. 
On the other hand, for larger di, spatially inhomogeneous 
patterns are reached as attractors for most initial conditions. 



self is not a transient orbit to a fixed point required here, 
slight structural perturbation on the heteroclinic cycle 
can lead to transient orbits on low-dimensional manifold 
with some stagnation points. At this point, it is interest- 
ing to recall that a class of threshold-network dynamics 
can generally produce heteroclinic cycles [2(| . 

Of course, generation of novel states is important in the 
study of biological cell differentiation. As the number of 
cells increases through the developmental process, they 
interact with each other, and some cells start to exhibit 
different gene-expression patterns. Indeed, the sponta- 
neous cell differentiation process has been discussed the- 
oretically as isologous diversification 0, 0]. 

Considering that eq.(l) is a simplified form of gene- 
expression dynamics, the present mechanism of state dif- 
ferentiation may be relevant to the cell differentiation, 
since novel states stabilized by the (cell-cell) interaction 
take gene-expression patterns distinct from those of the 
original attractor. Indeed, mutual stabilization and hi- 
erarchical ordering of cell types, observed in the present 
model, may be important to the discussion of robustness 
and irreversibility in the cell differentiation process (T^|. 
Here, it is interesting to note that long transient dynam- 
ics on a low-dimensional manifold has recently been ob- 
served in a g ene network model constructed from biolog- 
ical data[21|. 

To close the paper, we again note that inclusion of 
spatially local interaction to the present study is quite 
straightforward. In a one-dimensional lattice, one can 
adopt a nearest-neighbor diffusive interaction model as 
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given by 

M-l 

Xi(k) = tanh[/3 JijXj(k) — 9i] — Xi(k) 

3=0 

+di{ Xi (k+l)+ Xi (k-l) (5) 

In this case, generation of novel states by the present 
mechanism works. Without coupling (i.e., by taking 



d, = 0), only a homogeneous state with a stable fixed 
point exists, while with coupling spatially inhomoge- 
neous pattern appears, depending on the initial condi- 
tion. " Spots" of novel states are distributed with some 
distance, leading to spatial configuration of differentiated 
elements. Note again that this pattern formation is not 
a result of symmetry breaking as in Turing pattern[22j|. 
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